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ABSTRACT * » . 

The presentation summarizes data from a 5-year 
longitudinal study involving 108 special needs students who were part 
of a cooperative vocational exploration and training program for the 
handicapped. The program, designed to overcomie obstacles in rural 
areas, moved from a centralized to decentralized model of vocational 
service delivery that featured such aispects as a prioritized sequence 
of desired employee skills and behaviors, a series of 14 vocational 
curriculum teaching modules, and a resource teacher training plan. 
Descriptive ^statistics are presented summarizing the major student 
characteristics, school variables, and community-county 
characteristics. . Significant predictor variables were identified. 
Three major conclusions were drawn: (1) verified handicap, gend'er, 
full sea IQ, family involvement, and absence were among major 
client characteristics predictive of .outcbmes; (2) major school 
variables predictive of outcomes included school enrollment, semester 
hours in vocational programs, and total years of teaching by the 
resource teacher; (3) major county community characteristics 
predictive of outcome included per capita income, number of 
businesses, and labor force. (CL) 
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The demand for . accountability and outcome evaluation of special ed- 
ucational services "has grown steadily during the last few years (Schalock, 
1983; Voeltz & Evans, 1983) •. ^Many educators, however, are not generally 
.enthusiastic about evaluation, since many perceive it as an externally 
imposed^ requirement for which there is' neither adequate preparation nor 
sufficient funding, while others feel that evaluation methods are insensi- 
tive to their program's complexities or student characteristics* .Many 
schools, in addition, have only one special education program, do not 
consider themselves as. part of the "larger community", and thereby typically 
use their own approaches to assessment, training, and program evaluation. 

This demand for accountability is one of a number of current trends 
directly affecting the provision of services to special needs students. 
A second trend relates to our appreciation of the significant effects 
that environments have on behavior • This ecological, or person-environment 
perspective, incorporates one or more 6f the following premises: (ai) 
individuals cannot be separated fi*om their living-working environments 
(Stuckey & Newbrough, 1981; Wicker, 1979); (b). both persons and their 
environments can be aasesaed (Dokecki, 1977; Karan & Schalock, 1983; McLain, 
Silverstein, Brovnlee & Hubbell, 1979)} (c) the mismatch between persons 
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and their environment can be reduced through the development of behavioral 
skills, use of prosthetics or environmental modification. (Schalock, 1983; 
Weisgerbej, Dahl & Appleby, 1980,); .(d) intervention should focus on care- 
givers and settings as much as on the handicapped person (Berkson-fi Romer, 
1981; Karan, 1932; Landesman-Dwyer, 1981; Seltzer, 1981; Wilier & Intagliata, 
198'1); and (e) assessment and training activiti.iBS should have both ecologi- 
cal, and social validity (Brooks & Baumeister, 1977; Kazdin & Matson, 1981). 

Consistent with the ecological perspective is a third trend affecting 
special education, services. This trend relates to social- validation that 
has recently been proposed as a method to identify training areas within 
special education based , upon societal input (Kazdin & Matson, '1 981 ) , .One 
aspect of social validation is descriptive validation assessment in which 
the. , required skills, of the placement environment are determined either 
througii '.observation, survey or verbal input . (Rusch, Schutz & Agran, 1982). 
Once those required, or criterion environment (Brown ^et al. , 1981) skills 
are delineated, then behavioral skill training is best conducted within 
that natural environment (Brown, Nietupski, & Hamr.e-Nietupski, 1976; Freagan 
& Rotatori, 1982; Martin, Rush & Heal, 1982; Schalock,. Gadwood & Brown, 
^^8Af Wehman & Hill, 1982). Training in the natural environment will maxi- 
mize both skill acquisition and maintenance since stimulus .control and 
response generalization are more likely when the stimuli controlling behavior 
in a training situation also are present in the. transfer setting (Horner, 
1981; Rincover & Koegel, 1975; Stokes & Baer, 1977). , ' / 

The purpose of today's presentation is to summarize data from, a 5- 
year longitudinal study involving 108. special need students who were part' 
of a cooperative vocational exploriation and training program for the handi- 



capped. The original stimulus for the.^prpgram was a thr«e year Handicapped 
Children" s Model Program Grant awarded to Education Service Unit #9 by 
the Office of Special Education. The program was developed and- evaluated 
within the context . of the three' trends discussed above, namely the need 
for program accountability, outcome measures, and ecological-social validity. 

The service delivery model developed was based on the concept of cooper- 
ative efforts by the local school districts, ESU #9 (an intermediary agency), 
and local ■ business and industry. The rationale for the program model was 
based on the recognition of service delivei^y barriers presejit in rural 
Nebraska, that had . previously discouraged the development of comprehensive 
vocational services for secondary handicapped students. These barriers 
include an uneven distribyition of the special education populations over 
a large, geographical area, numerous s'raall independent school districts 
unable to provide comprehensive vocational services, a lack of business 
and industry, and traditionally orientated board policies that place an 
emphasis upon academic achievement rather than vocational competence. ^ 

The Cooperative Vocational Program was designed to serve an already 
identified, handicapped population of 228 ■ secondary level students from . 
approximately 18 school, districts. Eligible program participants were 
16 years or older, had been verified" as specific learning disability, mental- 
ly retarded,' or "educable menta,lly retarded, and were enrolled in school dis- 
trict .special 'education resource programs scattered over a five county 
geographical area. 

During the . first year, the Project piloted a centralized model of 
vocational, service delivery. The model was cnntralized in that a core 
, project staff, ba^ed at ESU #9 in Hastings, assumed responsibility for 



the development and delivery of vocational services to the target .population ^ 
enrolled in 18 secondary/ resour -^e programs. Project staff consisted of 
3 job pi.acement consultants, a program coordinator f and a program director. 
Services provided' duriijg . the first year, included identification and referral, 
vocational evaluation, individual* vocjational/educational program development, 
job explorations, and on-the-job "training (OJT). 

A matched subjects ^design was used to evaluate the outcome of the 

*■* • ■ ^ 

one 'year centralized model. Ten graduating students who had received cen-.' 
tralized services were matched to 10 students who did not. Data were gather- 
ed^ on these_20_students jr^arding^_school_ ijivolyement j^^ characteristics., 
vocational training received during the one year of the centralized project, 
and outcome , information including employmejit history .and living arrange- 
ments for two years following graduation. Although there were significant 
differences between the two groups on vocational training variables, whjoh^ 
indicated that the centralized service deliv'ery model changed the schools', 
approach to " vocational training,; there were no significant differences 
between the two groups on any of the outcome measures. The" major prograij ■ 

a 

evaluation variables are summarized in Table 1 . 

• Refer to Table 1 



Because ' of these results, the decision ' was made to move' away froui 
the centralized model to a more decentralized model of vocational service 
delivery . The decentralized model placed emphasis upon the secondary re- 
source teacher in ^earning how to implement and deliver vocational services 
and activities at the local school -^district level^ 'that had previously been 
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' . SUrWARY OF CENTRALIZED moOEL PROGRAfl. EVALUATION DATA 

0' " ■ ■ 



Variable 


^ Centralized Model 




Non-Centralized 




t-ratio 
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Current Livings 
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In-Home 

« *' ' ■ 
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(Chi-'square value =•34. 

£<.001). 


Out of Home 
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Source of Income: 












, Family > 
Public 


5 




3 




■ "^'(Chi-aquare value "sW--'- -- 

£<.001) 


"Employment 


■ 3 




7 






SCHOOL CHARACTERISTICS; ' 


- ■ 




- ■ 


- - 
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School Enrollment (Hundreds) 


7.8(5.0) 




" 9.^5.7) 




-D.25 


§ Vocational Programs 






• f \ • y 1 




1 in 


Administrative Support 










n nn 


Resource Teacher Resides in Community of Job Placement 




: 






UiOU ^ 


Resource Teacher Teaches in Community of Job Placement 
(H of Fndnrfipmpnts 1 

0 


3.2(.9; 
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TRAINING SERVICES; 












Total Days Absent. 


16.2(16) 




21(19) 




-0.70 


fl^onth/SPEO 


'18. (.00) 




17(2.^) 




1,24 


% Time/Resource Room 


.^2(.>'50) 




.^6(.32) 




-6.83 



Table 1 (continued) 



Variable 



Centralized Model 



Non^-Centralized 



t-ratio 



Semester Hours in Uocational Training 
Job Exjplorations^ 

Student Placed in Job Exploration Area 
Job Training Experiences^ 
0UTC0P1E PIEASURES t ' . 

Proportion in Regular Employments^ 
■ Average Hours/Week ^ 
Average Wage/Hour 

iWeeks Employed siricie Graduation ' - - 



11.5(9) 
■ .95^ (.7) 
.60^(.5) 
.70d(.5) 

32(18) 
$3.18(1.7) 
.. 29.2(23) 



15.6(U) 

f 

0 (.0) 
0(.0) 

.P(.o) 

1.1(.7) 

31(15) 
$3.52(1.5) 

• 39(1.9) 



-1.50 
3.86** 



3.67 
^.58 



-1.15 
-0.27 
-0.99 

■.•=1...27. 



^ Tuio pairs were verified as "specific learning disability"; two as "mentally retarded"; and six pairs verified "educable mentally handicapped." 

^ Clean . . 

c 

standard Deviation , 
^ The proportion of students placed in job exploration, training, or regular employment since graduation. 
^ A 'Student had to be employed for 90 days before being considered as "regularly employed*" 



the responsibility of the centralized project staff. "The rationale for this 
approach was based 'on the p^revio.usly summarized evaluation data, lack of. 

staff and budgetary resources to effectively continue service delivery to 

' ■ i> - 

a target population enrolled in widely scattered school district programs, 

and the need to assist each school district to utilize resources already 
available within its community. 

The essential feat^ures of the decentralized model (that provides the 

\> ■ ■ 

-data for today's presentation.) are summarized in Table 2. 
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One of the most .critical aspects of the prbject was the initial, employer 
survey. Businesses were surveyed in 16 communities within south-central 
Nebraska. A description of the sample and return rates is summarized below:' 



Types of Business Receiving Survey : Size of Businesses Receiving' Survey; 

Marketing; retail & wholesale (78) Small 1-50 Employees 

Manufacturing . {J^O) Medium 51-250 Employees 

Service ' (78)- Large 251+ Employees 

Total Number of Survey's Mailed: 198 Total Number of Returns Received ; 

. Total Number of Communities • Marketing: 56% of all sizes 

Involved in Survey : 16 « x • ^ 
^ ^ Manufacturing: 45% of all sizes 

Service: 41% of all sizes 

^7 — 



Each employer wa", asked to rate ■ 27 skills using a three point rating 



scale: 

(1) Skill is 'unimportant for entry-level person to have. 

(2) Skill is important, but it is not necessary to get an entry-level 
position. 



LU 



Table 2 

CHARACTERISTICS OF THE DECENTRALIZED MODEL 



1. An extensive survey of rural community employers concerning desired 
■ ■ skills arid -^behaviors" ^or-'entry-ievel* employees. •.--/c.. :r . ■ ....... 

2. A Student Competency Checklist incorporating a prioritized sequence 
. ,9^„ desired employee skills and behaviors. 

3. A series of" 14 vocational curr,iculum teaching modules based on skill 
and behavior priorities identified by local employers. 

4. • A resource teacher training plan, wherein the project staff worked with 

each teacher on a consultative basis and conducted monthly seminar/ train- 
ing se^ions in- job analysis, job development, and on-the-job support 
activities. 

5. A Program Handbook of vocational services and activities that provided 
the resource, teacher with specific procedures to: 

a. Facilitate- a cooperative working relationship between community 
employers, schools and teachers. 

b. Encourage program ownership, at the school district level through 
solicitation of school administrator and teacher participation 
and input in program related decision-making processes and activi- 
ties. 

c. Maintain a data base related to student and school ctiaracteristics, 
vocational education/training services, and specified outcome melts- 
ures. 
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(3) Skill is both important and necessary to get an entry-]evel posi- 
tion. 

An analysis of the employer responses revealed that the 27 skills could 
be grouped into three' major categories including: - (a) critical skills; 
(b) desired skills but not necessary for all jobs; and jc) pre-vocational 
skills. The 15 critical skills, . and their relative ratings, , are listed 
in Table 3. • ' - 
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As mentioned previously, the ■ major purpose to today's presentation 
is to, summarize the data from a longitudinal study involving 108 studefits 

who graduated between 1979 and 1,983 from schools involved with the project. 

a 

These students have been contacted at least yearly since graduation. Complete 
data were available for each student on the program evaluation variables 
•listed in ?:^ble 4« . ■ 
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» Results 

Time precludes summarizing all the results . of the study. We have chosen 
to present today those results that we feel will be the ' most interesting 
and valuable. Descriptive statistics summarizing the major student charac- 
teristics, school variables, and community-county characteristics are present- 
ed'in Table 5. " 



Table 3. 
CRITICAL ENTRY-LEVEL SKILLS 



Skill 


Percent of Employers Rating Skill as: 
(lia (2)b (3)c 


1". Demonstrates Droper hygiene — - 


- --I-?- - 




49 


2. Knows appropriate action to 
take in an emereencv situation 


9 




A8 


. 3. Identifies potential safety 
hazards on the job 


. 1 


39 


51 


4. Demoastrates good listening 
habits 


6 


26 


69, 


5. Follows written and spoken 
instructions 


2 


'17 


' 79 


6. Reads signs, forms, newspapers, 
phone books, functional words, 
and abbreviations 




26 


69 


, 7. Knows how to ask questions for 
directions, information, per- 
sonal" needs, etc. 


k 




71 


8. Practices appropriate behavior 
•in public/work settings (i.e., 
accepts criticism, shows per- 
sonal initiative) 


3 


3A 


63 


9. Recognizes skills necessary 
for interpersonal relatipn- 
ships in work settings 


10. 


■ 51 . ■ 


AO 


10. Knows importance of quality 
standards on the job 


S 


19 • 


70 


— 11. Recugnizos rolatiom^p-be^ 

teen time and x^ork/rate 
production , , 


- 10 


38 


52 


12. Identifies, problems (job re- 
lated) and seeks proper assis- 
tance » 


3 

* 


37 


59 . 


13. Recognizes importance of ^ ^ 
punctuality & attendance ^ 


7 




80 


H. Estimates time needed to 
complete job tasks 


22 


52 , 


26 • 


'15. Demonstrates ability, to work 
without immediate supervision 


9, 


37 


" 5A 



^ Skill is unimportant for. an enti-y-level person to have. 
^ Skill is important, bub it is not necessary for an entry-level position, 
Skill is both important and necessary to get an entry-level position. 



Table I, 

PROGRAM EVALUATION. VARIABLES 



STUDENT CHARACTERISTICS 

Age ' ■• \ ' . 

" IQ (WAI3/WISCFull Scale) 
Verified Handicap . . , 

Gender 

Total Days Absent 4^ 
Family Involvement" 
SCHOOL VARIABLES , ^ • 

Number Months in Special Education (SPED) 
Percent of Time in Resource Room 
School Enrollment 
Days Absent . 

Number of Vocational Programs Offered by the School 
Number of Semester Hours Enrolled in One or More Vocational Programs 
. Resource Teacher; Total Years Teaching 
Resource Teacher: Number of Endorsements 
COMMUNITY/COUNTY CHARACTERISTICS 
Population 
Per Capita Income, 

Number of Businesses (By* Category) » . , 

Labor Force 

Une mplo yggg Oiat e-j(^yLjy.aar-) ^ . — -= 

OU TCOME measures ' • ^ 

Preaent-^Siatus — - - ■ — - - 

' Current Living Situation/Environment 
^ Current. Primary Source of Income 
Employment Data 

1) Average hours ]:er week 

2) Average hourly wage 

3) Weeks employed per year 

4) Number of jobs since graduation 

5) Total months employed since graduation 

6) Total earningssjjic e gradua tion J 

7) " ""Job"Types;~~7 "~I — ~ 

8) Reasons for losing job(s) 
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The major outcome; . variables are . summarized in Tablg 6. .These data 

• , . Refer to. Table 6 ' ' ' ' 



are averaged across verified handicaps • The data for each handicapping 
condition will be presented latef. 

The number of students within different job categories is present in 
Table 7. The'' job categories are those used by the Nebraska- Department of 



Refer to Table 7 

Labor and include only those jobs currently held. Table 7 also summarize.^ 
the major reasons students lost jobs. 
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Tftble 5 

STUDENT CHARACTERISTICS, SCHOOL VARIABLES AND 

COMMUNITY-COUNTY CHARACTERISTICS 
(N = 108) 





• Variable 


Mean 


Standard Error of 
The. Mean 



Student Characteristic . 
Age (At Graduation) 

Verified Hahdioap^'' 
Gender.. 

Total Days Absent' " . . 
Family Involvement^ 
School Variables \ 
Number months in Special Ed. 
Percent of Time in Resource Room 
School Enrollment 

Number of Vocational Programs/ School 
Number of Semester Hours in -Voc, Program 
Resource Teacher: Total Years Teaching 
Resource Te:acher: Number of Endorsements. 
Community Characteristic 
— Po|ml-a4i-oiv^X-r-housand6-^ 



18.3 . 0.09 

79.97 1.95 

82 males/26 females 

16.5 1.20 

1.8 0.06 

16.5 . . • 0.30 

28 2.62 

.•7A7 ' 67 

4.7 0.08 

■ 18-.3 . - T.-A^r- 

■^0.6 _ 0.99 

2.7 0.09 



Per Capita Income (Thousands)' 
"Number of" Businesses (Thousands) 
Labor Force (Thousands) 
Unemployment Rate 



-1&.S^ 



10.06 
1.73 
9.59 " 
A. 2% 



0.13 
0.05 
0.59 
0.39 



^ Number of students verified as specialized learning disability was 66; 
mentally retarded, 11; educable mentally handicapped, 31. 

b 



Rating Scale: .1 = low; 2 = medium; 3 == high 
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Table 6 
MAJOR OUTQOME VARIABLES 
(May, 1984; *N = 108) 



-Mea-n- -or Standard-ErxQE. 



Variable Number ol' .Mean 



Present Status 

Employed . • ' ■ 66 (61%) 

Unemployed • ■ 21 (25%) 

School (Technical/State College) .6 (6%) 

Community Based Mental Retardation Program , 5 (5%) 

Prison/Mental Health Facility U (4%) 

Current Living Environment . 

Supervised (Home, . Group Home) 66 (61%) 

Semi-independent (Staffed Apt., Dorm) .18 (17) . 

Independent 24- (22). 

Current Primary Source of Income 

Parents/Relatives - 33 (31%) 

Public 8 (7%) 

Persdnar-^ ' - • - ~ - , -67 (62%) ^ ^: - - •• 

Employment Data 

Average Hours/Week 22.02 1.96 

Average Hourly Wage "'2.^1 " 

Number of Jobs Since. Graduation 1.11 0.10 

Total Months Employed Since Graduation ■ 17.87 1-72 

Total Earnings 'Since Graduation 10.91 1.20 
(Thousands) 
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Table 7 . 

NUMBER OF STUDENTS PER JOB CATEGORY 
AND REPORTED REASONS FOR TERMINATION FROM JOB 



Job -Category 



Number of Job Holders 



1 . 




13 


('17%) 


2. 


Apt*! ml t.UTP SfiTvifip 




(5%) 


Q 


rllliing 


0 








2 


(3%) 


y • 


Mn mifn p"!" 11 T*"! ncT • Non— Hut Vil p flnofiK 


6 


(8%) 


u • 




9 


(12%) 


7. 


Transportation and Public. Utilities 


0 




8. 


Wholesa,le Trade . . 


b 


/ 


9. 


Retail Trade 


9 


(12%) 


10. 


Finance, Insurance, Real Estate 


0 




11. 


Services 


.25 


(33%) 


12. 


Federal Governnient - Civilian 


0 




13. 


Federal Government -j- Military 


8 


(11%) 


u. 


Stats and Local Government 

Total = 76 • 


0 





"erraination Reasons 



a 



1. Too Slow 

2. Went out of Business 



J. Quit 

A. No -Transportation 

5. Change of Job (voluntary) 

6. Laid Off 

7. Other 

8. Personal 



Number 

4 (13%) 
' 3 (10%) 

0 

13 (43%) 

5 (17%) 
1 (3%) 

1 (3%) 
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Table 8 presents the average hours worked per week and hourly wages sum- 



Refer to Table 8 



marized- for a number of individual characteristics and predictor variables. 
A step-wise multiple regression analysis was run against each outcome variable 
to determine the relative contribution .of the 1.8 predictor variables. Table 
8 lists only those predictor variables up to which the multiple R square was 
maximized and the overall F score was significant. - . . 

Table 9 summarizes a similar type of analysis for three additional outcome 
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measures, including number of jobs held , (for 3 months or longer) since . gradu- 
ation, . 'total months employed since graduation, and the total earnings (in 
thousands) since graduation^. Similar step-wise multiple regression analyses 
were run against each of these outcome measures as described for Table 8« 

In summai^ a number__of__concl usions ca n be d rawn from the data presented 



in Tables 8 and 9- These include: .. 

1. The major client characteristics predictive of outcomes (and positively 

: 4l ■ ■ • 

correlated therewith) include verified handicap (SLDs dO' much better), gender 
(males do better), Full Scale IQ, family involvement, and total days absent 
(negatively correlated). * 

2. The major school variables predictive of outcomes (and positively 
correlated therewith) include school, enrollment, semester hours in vocational 



programs, and total years of teaching by the resource teacher. 
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3. The major county / community characteristics predictive of outcome 
(also positively correlated) include per capita income, number of businesses, 
and labor force. • 
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Table 8 



AVERAGE HOURS WORKED PER WEEK AND HDURLY WAGES 



CLIENT CHARACTERISTICS 



DUTCDWE VARIABLES 



Hours/Week 



Wages/Hour 



Specific Learning Disability (N = 65) 
Educable. Mentally Handicapped (N = 31) 
Mentally Retarded (N =12) 
Females (N. = 26) 
Males (N = 82) 

Family Inuoluement - Poor (N = 32) 
Family Inuoluement - Fair (N = 61) 
Family Inuoluement - Good (N = 15) 

PREDICTDR VARIABLES ^ 
IQ 

Gender 

Family Inuoluement 

Semester Hours/Vocational Programs 

School Enrollment 
Handicap 



26.9 
19. D 
3.5 
11.^ 
25.4 
15.1 ■ 
2k.l 
26, D 

21.17b* 

15.66* 
, 12.35* 
1D.64* •' 

.9.98* 
9.D4* 



$2.78 
$2.22 
$D.85 
$1.49 
$2.70 
$1.58 
$2.69 
$3^04 



11.96b* 
8.99* 
11.27* 

7.75 
8.13 



^ Only those. predictor variables are listed for which the multiple R squared was maximized 
and the overall F score was significant. ' • 

F = Statistic . - • 



E < -01 



18 



21 



Table 9 



EMPLOYMENT SINCE GRADUATION: NUMBER OF JOBS HELD, 
TOTAL MONTHS EMPLOYED AND TOTAL EARNINGS ■ 



CLIENT CHARACTERISTIC 

SLO (N =65) 
EMH (N =\il) 
MR (N = 12) 
Females* (N = 26) ., 
Males (N = 82) 

Family Involvement - Poor (N = 32) 
Family Involvement - Fair (N = 61 ) 
family Involument - Good (N = 15) 

Predictor Variables ^ 
IQ 

Family Involvement ~' 
Psr Capita Income^ 

Total Years Teaching 
Verified Handicap 



No. Jobs 



Outcome Variables 



-Tctal Days- Absent .... 

c 

No. Businesses 
Labor Force 

Semester Hours/Vocational Programs ' 



1.3 
1.1 
0.3 
0.7 
1.2 
0.7 
1.3 
1.4 



9.92^"* 
9.46* 



Months Employed 

20.0 . 
16. B 

9.4 

9.1 
20.6 
12.4 
19.0 
25.^ ' 



10.83' 
10.97' 

12.47* 
12.10* 

9.92* 
9.18* 



9.23' 



Only those predictor variables are listed for which the multiple R squared was maximized 
and the overall F score was significant. 

F = Statistic 



Pe: county where job placed 
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